Would Humans Be Smarter If We Had Bigger Brains?

Would people be more intelligent if our brains were bigger or it had more neurons and synapses? This question was originally answered on Quora by Fabian van den Berg.